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NOTICES 


DEPARTMENT  OF  JUSTICE 

Office  of  the  Deputy  Attorney  General 

QUESTIONS  AND  ANSWERS  ON  THE 

FEDERAL  EXECUTIVE  AGENCY  GUIDE¬ 
LINES  ON  EMPLOYEE  SELECTION 

PROCEDURES 

Introduction 

The  problems  addressed  by  the  Fed¬ 
eral  Executive  Agency  Guidelines  on  Em¬ 
ployee  Selection  Procediu*es  (41  PR  51734 
et  seq.,  Nov.  23,  1976)  are  numerous  and 
important,  and  some  of  them  are  com¬ 
plex.  The  history  of  the  development  of 
those  guidelines  Is  set  forth  in  the  In¬ 
troduction  to  them  (41  PR  51734-35). 
The  experience  of  the  Department  of  La¬ 
bor  In  administering  its  earlier  Testing 
and  Selection  Order  (41  CPR  Part  60-3) 
has  been  that  a  series  of  answers 'to 
conunonly  asked  questions  is  helpful  in 
providing  guidance  not  only  to  employ¬ 
ers  and  other  users,  but  also  to  psychol¬ 
ogists  and  others  who  are  called  upon  to 
conduct  validity  studies,  and  to  compli¬ 
ance  officers  and  other  F^eral  personnel 
who  have  enforcement  responsibilities. 

The  three  Pederal  agencies  Issuing  the 
guidelines — the  Departments  of  Justice 
and  Labor  and  the  CTivll  Service  Com¬ 
mission — seeking  to  benefit  from  the  ex¬ 
perience  of  the  Department  of  Labor, 
and  recognizing  that  the  goal  of  a  tml- 
form  position  on  these  issues  can  best 
be  achieved  through  a  common  inter¬ 
pretation  of  the  same  guidelines,  have 
decided  to  issue  the  following  Questions 
and  Answers.  The  material  Included  is 
Intended  to  interpret  and  clarify  the 
provisions  of  the  guidelines.  The  ques¬ 
tions  selected  are  commonly  asked  ques¬ 
tions  in  the  field  and  those  suggested  by 
the  guidelines  themselves  and  by  the  ex¬ 
tensive  comments  received  on  the  vari¬ 
ous  sets  of  proposed  guidelines  prior  to 
their  adc^tion.  Terms  are  used  in  (he 
questions  and  answers  as  they  are  de- 
toed  in  the  guidelines. 

The  three  agencies  recognize  that  ad¬ 
ditional  questl(xis  may  be  appropriate 
for  similar  treatment  at  a  later  date,  and 
contemplate  working  together  to  provide 
additional  guidance  in  interpreting  the 
guidelines.  Users  and  other  Interested 
persons  are  invited  to  sulxnit  additional 
C(xnmonly  recurring  questions  they  be¬ 
lieve  warrant  answers,  and  any  com¬ 
ments  on  the  questions  and  answers  set 
forth  below  to  the  appropriate  issuing 
agency. 

HARCU.D  R.  Tyler,  Jr., 
Deputy  Attorney  QeneraL 

Lawrence  Z.  Lorber, 

,  Deputy  Assistant  Secretary,  Di- 
■  rector.  Office  of  Federal  Con¬ 
tract  Compliance  Programs. 

James  C.  &>tT, 

,  Executxoe  Assistant  to  the 
/  Commissioners,  United  States 

''  Civil  Service  Commission. 

January  17,  1977. 

1.  Q.  What  is  the  purpose  of  the 
Guidelines? 

A.  The  Guidelines  are  designed  to  aid 
In  the  achievement  of  our  Natlcm’s  goal 

L 


of  equal  emc^oyment  (g>portunity  with¬ 
out  discrimination  on  the  grounds  of 
race,  color,  sex,  religion  or  national  ori¬ 
gin,  by  providing  a  set  of  principles  gov¬ 
erning  use  of  employment  selection 
procedures  that  is  consistent  with  appli¬ 
cable  legal  and  psychological  standards, 
is  workable,  and  which  the  adopting 
agencies  will  apply  in  the  discharge  of 
their  respective  responsibilities.  The 
Guidelines  deal  only  with  this  one  aspect 
of  the  overall  equal  employment  oppor- 
tmiity  question  and  do  not  purport  to 
provide  guidance  for  anything  other  than 
use  of  selection  procedures. 

2.  Q.  What  is  the  basic  principle  of  the 
guidelines? 

A.  Selection  procedures  which  have 
an  adverse  impact  on  members  of  a 
racial,  sex  or  ethnic  gi-oup  and  thus  op¬ 
erate  to  exclude  them  disproportionately 
are  unlawfully  discriminatory  unless  the 
user  validates  the  procedure  in  accord 
with  the  Guidelines,  or  the  user  other¬ 
wise  justifies  them  in  accord  with  Ped¬ 
eral  law.  See  §  3.^  The  basis  for  this  prin¬ 
ciple  was  adopted  by  the  Supreme  Court 
unanimously  in  Griggs  v.  Duke  Poater 
Co.,  401  U.S.  424,  and  was  ratified  and 
endorsed  by  the  Congress  when  it  passed 
the  Equal  Employment  Opportunity  Act 
of  1972. 

3.  Q.  What  is  adverse  impact,  and  how 
is  it  measured? 

A.  Adverse  impact  is  a  substantially 
different  rate  of  selection  in  hiring, 
promotion  or  other  emploiunent  decision) 
which  works  to  the  disadvantage  of 
members  of  a  racial,  sex  or  ethnic  group. 
S  4b.  Rate  of  selection  for  each  group  is 
determined  by  dividing  the  number  of 
applicants  selected  from  that  group  by 
the  total  number  of  applicants  from  that 
group  and  by  cranparing  the  results  with 
the  result  derived  in  the  same  way  for 
the  group  with  the  highest  selection  rate. 
For  example,  a  user  may  have  had  over 
a  six  month  period  120  ai^licants,  80 
white,  and  40  black;  of  whom  60  were 
hired,  48  whites,  and  12  blacks.  The  s^ec- 
tlon  rate  for  white  applicants  was  thus 
48/80=60%;  while  that  for  black  appli¬ 
cants  was  12/40=30%.  In  this  examine, 
the  selection  m^ess  adversely  affected 
the  employment  opportunities  of  blsu^ks 
because  their  selection  rate  (30%)  was 
only  one  half  that  of  whites  (60% ) . 

4.  Q.  What  is  a  substantially  different 
rate  of  selectirm.? 

A.  The  Guidelines  adopt  a  4/5  (80%) 
Rule  of  thinnb  for  guidance  and  (^ra¬ 
tional  use.  See  i  4b.  If  the  selection  rate 
for  a  group  is  within  4/5  or  80%  of  the 
rate  for  the  group  with  the  highest  rate, 
the  enf(»t)ement  agency  will  generally 


1  Section  references  throughout  these  ques¬ 
tions  and  answers  are  to  the  Sections  of  the 
Federal  Bzecntive  Agency  Guidelines  on  Em¬ 
ployee  Selection  Procedures  (herein  referred 
to  as  “Guidelines”)  that  were  published  by 
the  Department  of  Labor,  Department  of  Jus¬ 
tice  and  the  n.S.  CSvil  Service  Commission  on 
November  23,  1976,  at  41  FR  51734  et  seq. 
In  the  Department  of  Labor  issuance,  the 
section  references  are  preceded  by  an  ^dl- 
tlonal  reference  to  “i  60-3“  (thus,  the  refer¬ 
ence  hwe  to  {  3  refers  to  i  60-3.3  In  the  Labor 
Dq>artment’s  Issuance). 


not  consider  adverse  impact  to  exist.  In 
the  prior  example,  the  selection  rate  for 
blacks  was  30%,  while  that  for  whites 
was  60% ;  so  that  the  black  selection  rate 
was  1/2  or  50%  of  the  highest  group  and 
there  was  adverse  impact.  If,  on  the 
other  hand,  there  were  120  applicants,  of 
which  80  were  white  and  40  black,  and  the 
user  had  selected  42  whites  and  18  blacks, 
the  selection  rate  for  blacks  would  be 
18/40  or  45%,  while  that  for  whites 
would  be  42/80  or  52.5%.  Because  the 
selection  rate  for  blacks  as  compared  to 
that  for  whites  is  45/52.5  or  85.4%  (l.e., 
more  than  80%  (or  4/5) ) ,  the  difference 
in  impact  would  not  be  regarded  as  sub¬ 
stantial  in  the  absence  of  additional  in¬ 
formation. 

5.  Q.  Does  the  4/5  rule  of  thumb  mean 
that  the  Guidelines  will  tolerate  up  to 
20%  discrimlnatlcm? 

A.  No.  The  4/5  rule  of  thiunb  speaks 
only  to  the  question  of  adverse  Impact, 
and  is  not  Intended  to  resolve  the  ulti¬ 
mate  questkm  of  unlawful  discrimina¬ 
tion.  Regardless  of  the  amount  of  differ¬ 
ence  in  ejection  rates,  imlawful  dis¬ 
crimination  may  be  present,  and  may 
be  demonstrated  through  appropriate 
evidence.  The  4/5  rule  merely  establishes 
a  numerical  basis  for  drawing  Initial  in¬ 
ference  and  for  requiring  additional 
information. 

With  req?ect  to  adverse  impact,  the 
Guidelines  expressly  state  (§  4b)  that 
differences  in  selection  rates  of  less  than 
20%  may  still  amount  to  adverse  im¬ 
pact  where  the  differences  are  signifi¬ 
cant  in  both  sta^tlcal  and  practical 
terms.  In  the  absence  of  differences 
which  are  large  enough  to  meet  the 
4/5ths  rule  of  thumb  or  a  test  of  statis¬ 
tical  significance,  there  is  no  reason  to 
assume  that  the  differences  are  reliable, 
or  that  they  are  based  upon  anything 
other  than  chance. 

Two  examples  will  be  illustrative.  If, 
for  the  sake  of  Illustration  we  assume 
that  nationwide  statistics  show  that  use 
of  an  arrest  record  would  disqualify 
10%  of  all  Spanish-surnamed  persons 
but  <mly  4%  of  all  Anglo  persons,  the 
“selection  for  that  selection  pro¬ 
cedure  is  90%  for  Spanlsh-siumamed 
Americans  and  96%  for  Anglos.  There¬ 
fore,  the  4/5  rule  of  thumb  would  not 
indicate  the  presence  of  adverse  impact 
(90%  la  iqqDroximately  94%  of  96%). 
But  In  this  example,  the  sample  is  large 
enough  Ur  be  statistically  significant, 
and  the  difference  (Spanish-surnamed 
Americans  are  2^  times  as  likely  to  be 
disqualified  as  ^glos)  is  large  enough 
to  be  practically  significant.  Thus,  the 
enforcement  agencies  would  consider  use 
of  arrest  record  alone  as  having  an  ad¬ 
verse  impact.  See  Gregory  v.  Litton  In¬ 
dustries.  473  P.2d  631  (9th  Clr.,  1972). 

Similarly,  a  difference  of  more  than 
20%  in  rates  may  not  provide  a  basis 
for  finding  adverse  impact  if  the  mun- 
bers  are  very  small.  For  example,  if  the 
employer  selected  three  men  and  one 
woman  from  an  applicant  pool  of  20 
men  and  10  women,  the  4/5  rule  would 
indicate  adverse  impact  (selection  rate 
for  womoi  is  10%;  for  men  15%;  10/15 
or  66%%  is  less  than  80%>,  yet  the  num- 
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bers  are  so  small  that  a  difference  In  grams  In  tiwo  wstb*  Hrst,  the  Guidelines  procedure  may  also  be  permitted  if  the 
one  person  hired  woidd  show  an  adverse  state  (i  4e)  that  in  detmnlnlng  whether  user  can  otherwise  justify  such  nse  in 
impact  the  other  way.  In  these  clrctun-  to  institute  action  against  a  user  on  the  accMd  with  the  federal  law.  See  i  3b. 
stances,  the  enforcement  agency  wouW  basis  of  a  selection  procedure  wfaldi  has  12.  Q.  How  can  users  justify  continued 
not  require  validity  evidence  in  the  ab-  adverse  Impact  and  which  has  not  been  use  in  accord  with  fed^ial  laws  of  a  pre¬ 
sence  of  additional  information.  validated,  the  eoforcwnoit  agency  will  cedure  which  has  an  adverse  impact  and 

6.  Q.  Is  adverse  impact  determined  on  take  into  account  the  general  equal  «n-  which  it  is  not  feasible  or  s4>propriate  to 
the  basis  of  the  overall  selection  process  ploymrait  opp<Mtunlty  posture  of  the  validate? 

or  for  the  components  in  that  process?  user  with  respect  to  the  job  classifica-  A.  That  subject  is  one  to  which  the 

A.  Adverse  Impact  is  determined  first  tions  for  which  the  procedure  is  used  Guidelines  are  not  addressed.  In  Griggs 
for  the  overall  selection  process  for  each  and  the  progress  which  has  been  made  v.  Duke  Power  Co.,  401  U.S.  424,  the 
job  category.  If  there  is  no  adverse  im-  in  carrying  out  any  affirmative  action  Supreme  Court  indicated  that  the  burden 
pact  from  the  selection  process,  there  program.  If  the  user  has  demonstrated  on  the  user  was  a  heavy  one,  but  that  the 
is  no  obligation  under  the  Guidelines  to  over  a  substantial  period  of  time  that  selection  procedure  could  be  used  if  there 
validate  the  selection  procedures  used  it  is  in  fact  providing  equal  employ-  was  a  “business  necessity”  for  its  con¬ 
fer  that  job.  If  the  overall  selection  ment  opportunity  in  the  job  or  job  tinned  use.  The  federal  agencies  will  con- 
process  has  an  adverse  impact,  the  ad-  groups  in  question,  the  enforcement  sider  evidence  which  shows  “business 
verse  impact  of  the  individual  selection  agency  will  gehwally  exercise  its  dis-  necessity”  to  justify  continued  use  of  a 
procedures  should  be  analysed.  For  any  cretion  by  not  initiating  enforcemwit  selection  procedure.  Evidence  of  any 
selection  procedure  in  the  process  hav-  proceedings.  Secondly,  the  Guidelines  other  justification  would  have  to  be  con¬ 
ing  an  adverse  impact  which  the  user  encourage  affirmative  action  programs  sidered  mi  a  case  by  case  basis, 
continues  to  use,  the  user  is  expected  to  by  stating  (§11)  that  nothing  in  them  is  13.  Q.  Do  the  Guid^ines  t^ly  to  the 
have  evidence  of  validity  satisfying  the  intended  to  preclude  the  use  of  selec-  selection  procedures  utilized  by  state  and 
guidelines.  §  4b  and  S  5c.  tion  procedures,  consistent  with  Federal  local  government  licensing  and  certifica- 

7.  Q.  If  adverse  impact  is  determined  law,  which  assist  in  the  achievement  tion  boards  and  agencies? 

initially  on  the  basis  of  the  overall  se-  of  affirmative  action  objectives.  A.  The  Guidelines  neither  broaden  nor 

lection  process,  does  this  allow  discrim-  10.  Q.  Does  the  language  of  §  4c  and  narrow  the  coverage  of  the  imderlying 
Ination  in  one  selection  procedure  to  be  §  11  concerning  non-discriminati<m  in  federal  law.  The  Guidelines  state  how- 
balanced  by  another  discriminatory  the  making  of  employmMit  decisions  ever  that  licensing  and  certification  are 
procedure?  'prevent  the  adoption  of  effective  affirm-  employment  decisions  to  the  extmt  that 

A.  No.  As  shown  above  (see  answer  ative  action  programs?  l^iey  may  be  covered  by  federal  law.  The 

to  Question  5) ,  discrimination  and  ad-  A.  No.  The  Equal  Employment  Oppor-  courts  are  divided  that  question.  The 
verse  impact  have  different  meanings;  tunity  (Coordinating  Council  has  adopt-  Department  of  Justice  lias  taken  the 
and  these  Guidelines  do  not  permit  any  ed  a  policy  statement  cm  affirmative  ac-  positicm  that  at  least  smne  kinds  of 
kind  of  discrimination.  There  are,  more-  tiMi  programs  (41  Fed.  Reg.,  Sept.  13.  licensing  and  certification  which  deny 
over,  many  methods  of  determining  pro-  1976).  A  copy  of  that  statement  is  at-  persons  access  to  emi^yment  oppor- 
ficiency.  In  some  cases,  proficiency  may  tached  hereto  and  incorporated  hwein.  tunity  may  be  oijoined  in  an  action 
be  best  demonstrated  by  a  written  ex-  The  language  of  §  4c  and  §  11  is  baaed  bro^ht  pursuant  to  Section  707  of  the 
amination,  while  for  others  a  review'  of  upon  and  merely  intended  as  a  rwninder  Cfivil  Rights  Act  of  1964,  as  amended, 
experience  or  an  interview,  or  a  combi-  of  the  non-discrimination  provisions  See.  United  States  v.  North  CaroUna,  400 
nation  of  all  three  may  be  best.  Many  contained  in  Title  vn  and  Executive  P •  Supp.  343  (E JJ.  N.C.  1975)  (three  judge 
employers  said  other  users  are  utilizing  Order  11246.  The  policy  statement  on  court)  (certification  of  teachers) . 
alternative  or  combinations  of  s«)-  affirmative  actitm  contains  a  similar  pro-  14.  Q.  Where  can  a  user  obtain  a 
proaches.  Where  the  overall  selection  hibition  for  the  same  re€ison.  The  kind  “certification  of  validity”? 
process  of  a  user  results  in  equal  em-  of  color  conscious  affirmative  action  A.  The  federal  MiforoemMit  agencies 
ployment  opportunities  for  members  of  steps  outlined  in  the  Coordinating  do  not  recognise  any  certification  of 
racial,  sex  or  ethnic  groups  for  a  job.  Council's  policy  statement  do  not,  in  validity  or  validation.  See  i  7a.  If  a  user’s 
the  Guidelines  reflect  the  position  that  the  judgment  of  the  enforcement  agen-  selection  procedures  have  an  advNise  im- 
it  would  be  inappropriate  for  the  fed-  cies,  violate  the  language  of  f  4c  or  §  11  P«ct,  the  user  is  ex|>ected  to  produce  evl- 
eral  enforcement  agencies  to  expend  of  the  Guidelines.  Tiis  view  is  consist-  dence  of  validity  of  the  procedure, 
their  limited  enforcement  resources  ex-  ent  with  the  well  established  principle  iiot  a  certificate  that  they  have  been 
amining  the  validity  of  each  procedure  that  affirmative  action  programs  of  tois  validated.  Thus,  the  assertfcm  by  anyone, 
utilized  in  the  process.  kind  do  not  violate  the  conmarable  anti-  including  a  State  employment  service 

8.  Q.  Is  the  user  obliged  to  keep  rec-  preference  provisions  of  Title  VTI  or  representative,  that  a  test  battery  or 

ords  which  show  whether  its  selection  Executive  Order  11946.  other  selection  procedure  has  been  vali- 

procedures  have  an  adverse  impact  on  11.  Q.  If  it  is  not  feasible  or  a{H>roprl-  dated  is  not  sufficient  to  satisfy  the 
race,  sex  or  ethnic  groups?  ate  to  validate  a  selection  procedure,  Guidelines. 

A.  Yes.  Under  the  GulddUnes  Uie  user  what  obligaticms  does  the  user  of  such  15^  Q.  What  is  the  relationship  be- 
is  obliged  to  *"*«»*"  evidence  indicat-  a  mooedure  have?  tween  the  Guidelines  and  otiier  state- 

ing  the  impact  (if  any)  vdiich  their  se-  A.  The  Guiddines  recognize  that  It  is  ments  of  psychological  princlides,  such  as 
lection  procedures  have  on  identifiable  not  always  feasible  or  apprc^riate  to  tiie  Staiviards  for  Education  and 
racial,  sex  or  ethnic  groups.  S  4  a  and  b.  utilize  the  validation  technlqum  of  the  Psychological  tests  published  by  the 
If  the  selection  procedure  does  have  psychological  profession  as  contemplat-  American  Psyidudogtoal  Association 
an  adverse  impact  on  one  or  more  such  ed  by  the  Guidelines.  If  the  procedure  (Wash.,  D.C.,  1974)  (hereinafter  “APA 
groups,  the  user  is  expected  to  main-  cannot  be  validated  because  it  is  hi-  Standards")  ? 

tain  documentation  evidence  sliowing  formal,  unstandardized  or  unscored.  the  A.  The  Guidelines  are  designed  to  be 
the  validity  of  tiie  procedure.  !  13a.  user  shoidd  insofar  as  possible  eliminate  consistent  with  the  generally  accepted 

9.  Q.  What  is  the  relationship  between  adverse  impact,  or  if  feasUfie  modify  the  standards  of  the  psyduloglcal  prate- 

affirmative  action  and  the  requirements  procedure  to  one  which  is  formal,  scored  sion.  However,  to  the  extent  that  there 
of  the  Guid^hies?  or  quantified,  and  th^  validate  the  pro-  may  be  differences  between  particular 

A.  The  two  subjects  are  different,  al-  cedure  in  accord  with  these  Guideliaes.  provisiwis  of  the  GuideMnes  and  exiwes- 
though  rdated.  The  ChiidelineB  state  If  it  is  not  feasible  to  validate  a  stand-  skms  of  lurinciides  found  elsewhere,  the 
that  comidlanoe  with  these  GutdeUnes  ardiaed  selection  procedure,  the  user  Guidelines  wiU  be  girret  precedence  by 
does  not  reUeve  users  of  any  iJBrmattvdH  should  either  ad(H>t  an  alternative  pro-  the  enforcement  agencies.  With  respect 
action  nihi»gmi.««n.«8  they  BUty  have,  i  11.  ordure  to  eliminate  adverse  impact  or  to  any  mattes  not  artrirassed  by  tiie 
The  Guldelhies.  however,  encourage  the  modify  the  procedure  to  riimtoate  the  Guidelines,  users  are,  of  course,  free  to 
devdopment  and  effeetise  hnptanenta-  adverse  impact.  The  continued  use  of  follow  the  standards  of  the  profession  so 
tion  of  affirmative  actioa  plans  or  pro-  either  a  standardized  or  unstandardized  long  as  doing  so  is  consistent  with  appU- 
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(^ble  equal  employment  opportunity  re¬ 
quirements. 

16.  Q.  When  should  a  validity  study  be 
carried  out? 

A.  The  Guidelines  call  for  a  validation 
.study  whenever  a  selection  procedure  has 
adverse  Impact  on  any  racial,  sex  or 
ethnic  group.  If  a  selection  procedure  has 
adverse  impact,  its  use  in  making  em¬ 
ployment  decisions  without  adequate 
ev  idence  of  validity  would  be  inconsistent 
with  tlie  Guidelines.  Waiting  until  a 
selection  procedure  is  challenged  in¬ 
creases  the  risk  that  the  user  will  be 
found  to  be  discriminating  and  be  liable 
for  back  pay  awards,  plaintiffs’  attorneys 
fees,  loss  of  Federal  contracts  or  grants 
and  the  like.  Validatl(»i  studies  begun  on 
the  eve  of  litigation  have  seldom  been 
found  to  be  adequate.  Users  of  selection 
procedures  should  consider  the  potential 
benefit  to  their  emplosmient  systems  and 
the  savings  in  resources  which  can  result 
from  having  a  validation  study  completed 
or  well  under  way  before  the  proc^ures 
are  administered  for  use  in  «nployment 
decisions.  Public  merit  systems  typically 
have  a  special  obligation  to  validate 
selection  procedures  regardless  of  any 
expectation  that  adver.se  Impact  may  re¬ 
sult. 

17.  Q.  Are  there  any  special  require¬ 
ments  as  to  who  is  allowed  to  perform  a 
validity  study? 

A.  No.  a  validity  study  is  Judged  on 
its  own  merits,  and  may  be  performed 
by  a  member  of  the  user’s  staff,  a  consult¬ 
ant.  or  any  person  knowledgeable  of  the 
principles  of  vidldlty  research.  However, 
it  is  dhe  user's  responsibility  to  see  that 
the  study  meets  these  Guidelines  which 
are  based  upon  professionally  accepted 
standards. 

t8.  Q.  Can  a  selection  psocedure  be  a 
valid  predictor  of  pexformance  on  a  job 
in  a  certain  location  and  be  invalid  for 
predicting  success  on  a  different  job  or 
the  same  job  in  a  different  location? 

A.  Tes.  Differences  in  job  duties,  loca¬ 
tions  or  study  samples  can  affect  validity, 
so  that  a  selection  procediu*e  found  to 
have  validity  in  one  situation  may  not 
-  have  validity  in  different  circumstances. 
Conversely,  a  selection  procedure  not 
foimd  to  have  validity  in  one  situation 
msiy  have  validity  in  different  circum¬ 
stances. 

19.  Q.  Does  the  way  a  selection  pro¬ 
cedure  is  used  affect  its  validity? 

A.  Yes.  Selection  procedures  which 
have  been  properly  validated  can  be  used 
in  improper  ways.  For  this  reason  selec¬ 
tion  procedures  must  be  administered 
and  scored  in  a  standardized  manner 
during  the  research  and  must  continue 
to  be  administered  and  scored  in  the 
same  way  while  being  used  operationally. 
§  5d.  A  selection  procedure  which  has 
been  validated  as  predicting  success  on 
one  job  might  be  invalid  for  predicting 
success  on  another  job. 

Even  If  the  selection  procedme  is 
properly  administered  and  scored  and 
the  same  job  is  involved,  it  may  be  used 
improperly.  For  instance,  it  would  be 
improper  to  use  a  selection  procedure  to 
rank  applicsmts  if  the  validity  study  only 
supported  the  use  of  minimum  accept¬ 


ance  levels  C'pass/fail”) .  The  validity 
study  should  reflect  the  way  the  selection 
procedure  will  be  used  in  practice 

20.  Q.  Is  the  user  of  a  selection  pro- 
cedine  required  to  develop  the  procedure 
from  scratch? 

A.  No,  a  selection  procedure  developed 
elsewhere  may  be  used.  However,  the 
user  has  the  obligation  to  show  that  its 
use  for  the  job  in  question  is  consistent 
with  the  Guidelines. 

21.  Q.  Is  evidence  that  a  selection  pro - 
cedme  which  has  been  vaUdated  in  one 
context  has  validity  in  another  context 
(validity  generalization)  sdone  sufficient 
justification  for  its  use  elsewhere  (trans¬ 
portability)  ? 

A.  No.  The  conditions  governing 
transportability  are  stated  in  §  6  of  the 
Guidelines.  While  some  degree  of  valid¬ 
ity  generalization  is  necessary  for 
transportability,  it  is  not  sufficient. 

Validity  generalization  refers  to  the 
degree  to  which  the  results  of  a  criterion- 
related  validity  study  conducted  on  a 
selection  procedure  in  one  situation  lead 
to  inferences  concerning  the  degree  of 
validity  of  that  selection  procedure  or 
similar  selection  procedures  in  other 
situations.  Transportability  refers  to  the 
permissible  use  of  a  selection  procedure 
in  more  than  one  context.  Validity  gen¬ 
eralization  is  a  statistical  concept  con¬ 
cerning  validity  evidence,  while  trans¬ 
portability  is  a  judgment  concerning  use 
of  selection  procedure. 

22.  Q.  Under  what  circumstances  can 
a  criterion-related  validity  study  done 
elsewhere  be  used  as  sufficient  validity 
(evidence  to  meet  the  Guidelines  (on 
other  than  an  Interim  basis)  ? 

A.  A  validity  study  done  elsewhere  may 
be  used  as  suffieient  evidence  if  four 
conditions  are  met  (see  i  6b) : 

1.  The  weight  of  the  evidence  from  one 
or  more  studies  must  show  that  the  pro¬ 
cedure  was  valid  in  its  use  elsewhere. 

2.  The  job(s)  for  which  the  selection 
procedure  will  be  used  must  closely 
match  the  job(s)  in  the  original  study  as 
shown  by  a  comparison  of  results  (in 
terms  of  job  duties)  of  the  job  analyses 
in  both  contexts. 

3.  A  fairness  study  must  be  contained 
in  the  original  evidence  for  those  groups 
constituting  a  significant  factor  in  the 
user’s  labor  market  (see  Answer  to  Ques¬ 
tions  31-34  below). 

4.  There  are  no  variables  in  the  other 
study  or  studies  which  are  likely  to  affect 
validity  or  fairness  significantly  (see 
Answer  to  Question  23  below). 

23.  Q.  Under  what  circumstances  can 
a  selection  procedure  supported  either 
by  criterion-related  validity  evidence  ob¬ 
tained-  elsewhere  or  by  a  partially  com¬ 
pleted  validity  study  be  used  on  an  in¬ 
terim  basis? 

A.  Interim  use  of  criterion-related 
validity  evidence  is  permitted  in  three 
situations: 

1.  If  it  is  technically  feasible  for  a 
user  to  conduct  an  internal  validity  study 
and  there  are  significant  differences  b^^ 
tween  the  research  sample  in  a  study 
done  elsewhere  and  the  user’s  job  appli¬ 
cants  in  terms  of  such  variables  as  age, 
education,  job  experience,  etc.,  the  selec¬ 


tion  procedure  may  only  be  used  on  an 
interim  basis  pending  an  internal  valid¬ 
ity  study.  - 

2.  If  validity  evidence  obtained  else¬ 
where  does  not  contain  an  investigation 
of  fairness  the  selection  procedure  may 
only  be  ased  on  an  Interim  basis  until 
evidence  of  fairness  or  imfairness  is 
shown  either  from  other  sources  or  the 
user’s  own  study. 

3.  If  a  user  has  substantial  validity 
evidence  either  from  other  sources  or 
from  studies  being  conducted  by  or  for 
the  user,  but  which  are  not  in  complete 
compliance  with  the  Guidelines,  the 
selection  procedure  may  be  used  only  on 
an  interim  basis  pending  completion  of 
validity  studies. 

24.  Q.  What  are  the  potential  conse¬ 
quences  to  a  user  when  a  selection  pro¬ 
cedure  is  used  on  an  Interim  basis? 

A.  The  fact  that  the  Guidelines  permit 
interim  use  of  a  selection  procedure  does 
not  immunize  the  user  from  liability  for 
back  pay,  attorney  fees  and  the  like, 
should  use  of  the  selection  procedures 
later  be  found  to  be  in  violation  of  the 
Guidelines  (e.g.,  because  of  a  showing  of 
unfairness),  and  for  this  reason  users 
should  take  steps  to  come  into  full  and 
complete  compliance  with  the  guidelines 
as  soon  as  possible.  It  is  also  appropriate 
for  users  to  consider  ways  of  minimizing 
adverse  impact  during  the  period  of  in¬ 
terim  use. 

25.  Q.  Under  what  circumstances  may 
a  validity  study  conducted  co(H3eratively 
among  users  or  in  different  units  of  a 
multi-unit  organization  be  used  in  lo¬ 
cations  not  included  in  the  validity 
study? 

A.  A  selection  procedme  supported  by 
validity  evidence  obtained  from  a  co- 
opesative  or  multi-unit  stu(^  may  be 
used  in  new  situations  where  the  condi¬ 
tions  described  in  the  answer  to  Question 
22  are  met,  and  where  there  are  no  signi¬ 
ficant  dlflerences  between  the  applicant 
populations  and  the  research  subjects  in 
such  characteristics  as  age,  education, 
job  experience,  or  the  like. 

26.  Q.  How  does  a  user  choose  which 
validation  strategy  to  use? 

A.  A  user  should  select  the  valida¬ 
tion  strategy  which  Is  most  appropriate 
for  the  type  of  selection  procedure,  the 
job,  and  the  employment  situation.  Con¬ 
tent  validity  by  itself  is  limpproprlate 
where  the  selection  procedmes  are  meas¬ 
ures  of  aptitude  or  personality  traits, 
and  for  jobs  in  which  the  employee  is 
expected  to  gain  the  measured  skills  or 
knowledges  while  on  the  job.  In  such 
circumstances  criterion-related  or  con¬ 
struct  validation  strategies  should  be 
used.  On  the  other  hand  where  the  se¬ 
lection  procedures  are  work  samples  or 
measures  of  fully  developed  skills  or 
knowledges,  content  validity  is  appro¬ 
priate  although  criterion-related  valida¬ 
tion  techniques  could  be  used  where 
technically  feasible.  Where  a  sample  of 
sufficient  size  cannot  be  obtained,  where 
appropriate  measures  of  employee  pro¬ 
ficiency  to  be  used  as  criteria  cannot  be 
developed,  or  where  there  is  a  severe 
range  restrictlcm  in  scores  on  selection 
procedures,  and  this  range  restriction 
cannot  be  reduced  or  appr<H>rlately  cor- 
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reeled,  criterion-related  validity  may  be 
technically  infeasible. 

27.  Q.  Why  don't  the  Gulddlnes  c<m- 
tain  a  preference  for  criterion  related 
validity  over  cont^t  or  construct  va¬ 
lidity? 

A.  Generally  accepted  principles  of 
the  psychological  profession  do  not  rec¬ 
ognize  any  such  preference,  but  contem¬ 
plate  the  use  of  criterion  related,  con¬ 
tent,  or  construct  validity  strategies  as 
appropriate.  APA  Standards,  E,  m). 

25-26;  Washington  v.  Davis, _ U.S. 

_ ,  44  U.SJ:i.W.  4789,  fn.  13.  Moreover, 

the  Guidelines  normally  require  criterion 
related  evidence  as  a  component  part 
of  any  construct  validity  study  §  12d. 
With  respect  to  content  validity,  where 
the  content  of  the  selection  procedure 
closely  matches  the  behaviors  or  activi¬ 
ties  required  for  job  performance,  as  in  a 
typing  test  for  typists  or  a  truck  driving 
test  for  truck  drivers,  a  content  validity 
approach  is  the  most  appropriate  way 
of  showing  validity.  Because  the  Guide¬ 
lines  make  It  clear  that  content  validity 
by  itself  is  not  appropirate  for  aptitude, 
intelligence,  personality  or  Interest  tests 
(5  12c(l) ) ,  and  that  evidence  of  content 
validity  depends  upon  the  closeness  of 
the  resemblance  between  work  behavior 
and  the  selection  procedme,  there  Is  no 
need  or  justification  for  a  general  pref¬ 
erence  for  criterion  related  validity  over 
content  validity.  All  toree  strategies  are 
empirical^  based.  Construct  validity  re¬ 
quires  empirical  research  evidence, 
which  is  normally  criterion-related,  link¬ 
ing  the  selection  procedure  to  the  job, 
while  content  validity  requires  a  fac¬ 
tually  based  linkage  of  the  selection  pro¬ 
cedure  to  the  activities  of  the  job. 

28.  Q.  Is  the  use  of  a  content  validity 
strategy  appropirate  for  measuring  in 
the  selection  process  skills  or  knowledges 
which  are  taught  In  a  training  academy 
after  Initial  employment? 

A.  No.  TTie  Guidelines  state  (§  12c(l) ) 
that  content  validity  is  not  appropriate 
where  the  slectlon  procedure  involves 
knowledges,  skills,  or  abilities  which  the 
employee  will  be  expected  to  learn  “on 
the  job."  The  phrase  “on  the  job”  is  in¬ 
tended  to  apply  to  training  which  occurs 
after  hiring,  promotion  or  the  like. 

29.  Q.  Is  a  full  job  analysis  necessary 
for  all  validity  studies? 

A.  It  is  required  for  all  content  and 
construct  studies,  but  not  for  all  criteria 
in  a  criterion  related  study.  See  S  12a, 
and  §  12b(3) ,  Proper  measures  of  the  re¬ 
sults  or  outccunes  of  job  behaviors  such 
as  production  rate  or  error  rate  may  be 
used  without  a  full  job  analysis  where  a 
review  of  information  about  the  job 
1  shows  that  Uiese  criteria  are  important 
to  the  employment  situation  of  the  user. 
Similarly,  measures  such  as  absenteeism, 
tardiness  or  turnover  may  be  used  if 
these  behaviors  are  shown  by  a  review 
of  information  about  the  job  to  be  im¬ 
portant  In  the  specifics  situation.  A 
standardized  rating  of  overall  job  per¬ 
formance  may  be  used  if  the  user  can 
demonstrate  its  apprc^rlateness  for  the 
specific  job  and  employment  situation 
through  a  study  of  the  job.  Measures  of 
overall  job  performance  should  be  care¬ 
fully  developed  and  standardized,  and 


Ihelr  use  should  be  CM«fully  controlled. 
See.  Atbemarie  Paper  Co.  v.  Moody,  422 
US.  405  <1»TS). 

SO.  Q.  Ihider  what  circumstanoes  may 
suceeH  in  training  be  used  as  a  criteriofi 
in  criterion-related  validity  studies? 

A.  Success  in  training  is  an  appropri¬ 
ate  criterion  when:  (1)  Ihe  job  analysis 
shows  that  success  in  training  is  neces¬ 
sary  for  successful  job  perf<H-mance  or 
related  to  increasing  proficiency  on  the 
job;  and  (2)  training  success  is  properly 
measiued.  §  12b(3) .  Where  the  measure 
of  success  in  training  is  a  paper  and  pen¬ 
cil  test,  tile  measure  should  be  carefully 
developed  to  ensure  that  factors  whk^ 
are  not  job  related  do  not  imfairly  inflate 
or  depress  the  measiues  of  training  suc¬ 
cess  and  to  ensure  that  the  measures  are 
in  fact  job  related.  §  12b (3) . 

31.  Q.  What  does  “unfairness  of  a  se¬ 
lection  procedure”  mean? 

A.  Whoi  a  specific  score  on  a  selection 
procedure  has  a  different  meaning  in 
terms  of  expected  job  performance  fw 
members  of  one  racial,  sex  or  ethnic 
group  than  the  same  score  does  for  mem¬ 
bers  of  another  group,  the  use  of  that 
selection  prooedme  may  be  unfair  for 
members  of  cxie  eff  the  groups.  See  §  14 
(k).  For  example,  if  members  of  one 
group  have  an  average  score  of  40  (m 
the  selection  procedure,  but  perfeurm  on 
the  job  as  well  as  another  group  which 
has  an  average  score  of  50,  then  the 
selection  procedure  is  unfair  to  tiie 
members  of  the  lower  scoring  group. 
(The  concept  of  test  fairness  has  some¬ 
times  been  referred  to  as  differential 
validity  or  differential  prediction). 

32.  <3.  When  should  the  user  investi¬ 
gate  the  question  of  fairness? 

A.  Fairness  should  be  investigated 
generally  at  the  same  time  that  a 
criterion-related  validity  study  is  con¬ 
ducted,  or  as  soon  there^ter  as  feasible. 

33.  Q.  Why  do  the  Guidelines  require 
that  users  look  for  evidence  of  unfair¬ 
ness? 

A.  The  consequences  of  using  unfair 
selectiOTi  procedures  are  severe  in  terms 
of  discriminating  against  applicants  mi 
the  basis  of  race,  sex  or  ethnic  group 
membership,  or  in  terms  of  perpetuating 
the  effects  of  past  discrimination.  Ac¬ 
cordingly,  these  studies  should  be  per¬ 
formed  routinely  where  technically 
feasible  and  appropriate,  even  if  the 
probability  of  finding  unfairness  is  small. 
See  Albemarle  Paper  Co.  v.  Moody,  422 
U.S.  405,  435.  Moreover,  the  APA  Stand¬ 
ards  published  in  1974  call  for  the  in¬ 
vestigation  of  test  fairness  in  criterion 
related  studies  wherever  feasible  (pp. 
43-44). 

34.  Q.  What  should  be  done  if  a  selec¬ 
tion  procedure  is  unfair  for  one  or  more 
groups  in  the  relevant  labor  market? 

A,  The  user  has  three  options.  See, 
§  12b(7)  (iv) .  PTrst,  the  selection  instru¬ 
ment  may  be  replaced  by  another  vali¬ 
dated  instrument  which  is  fair  to  all 
groups.  Second,  the  selection  instrument 
may  be  revised  to  eliminate  the  sources 
ol  unfairness.  For  example,  certain  items 
may  be  found  to  be  the  only  ones  which 
cause  the  mifaimess  to  a  particular 
group,  and  these  items  may  be  replaced 


by  others.  Finally,  revisions  may  be  made 
in  the  use  of  the  selection  procedure  to 
ensure  that  the  probability  of  being 
selected  is  compatible  with  the  probabil¬ 
ity  of  successful  job  performance. 

35.  Q.  If  there  are  not  enough  mem¬ 
bers  of  an  adversely  affected  race,  sex  or 
ethnic  group  in  the  potential  research 
sample  to  make  it  feasible  to  study  test 
fairness,  should  tlie  group  still  be  in¬ 
cluded  in  the  sample? 

A.  Yes,  normally  the  study  should  be 
conducted  on  a  sample  which  is  repre¬ 
sentative  of  the  expected  candidates  for 
the  job  in  question.  However,  there  may 
be  situations  in  which  the  members  of 
the  race,  sex  or  ethnic  group  available 
for  the  study  are  so  dissimilar  from  other 
persons  in  the  sample  that  the  infor¬ 
mation  should  not  be  combined  for  data 
analyses. 

36.  Q.  Do  the  Guidelines  require  a 
search  for  alternative  selectiwi  proce¬ 
dures? 

A.  The  Guidelines  provide  that  while  a 
validity  study  is  being  conducted,  the 
user  should  attempt  to  find  and  apply 
procedures  that  have  as  little  adverse 
impact  as  possible.  However,  once  that 
effort  has  b^n  made  and  the  chosen  pro¬ 
cedure  has  been  studied  and  shown  to  be 
valid,  the  Guidelines  do  not  require  the 
user  to  search  further  for  alternative 
procedures.  The  Guidelines  do  call  for 
a  user  to  take  st^  to  ensure  that  selec* 
tion  procedures  are  kept  current,  and  to 
investigate  any  alternative  procedures 
shown  to  have  at  least  equal  vtdldity  and 
less  adverse  Impact.  The  obligation  to 
investigate  alternative  procedures  is 
greater  when  the  user  is  in  an  Interim 
use  status. 

37.  Q.  What  does  a  user  do  if  there  are 
not  enough  persons  in  a  job  to  conduct 
a  criterion  related  study? 

A.  There  are  a  number  of  options  the 
user  should  consider,  depending  upon  the 
particular  facts  and  circumstances. 

1.  CThanglng  the  procedure  so  as  to 
eliminate  adverse  impact; 

2.  Validating  the  procedure  through  a 
content  validity  strategy,  if  appropriate 
(see  §  12c  and  answer  to  Question  25  and 
27) ; 

3.  Using  a  selection  procedure  vali¬ 
dated  elsewhere  in  conformity  with  the 
Guidelines  (see  §  6  and  answers  to  Ques¬ 
tions  22-24) ; 

4.  Engaging  in  a  cooperative  study  with 
other  facilities  or  users  (in  cooperation 
with  such  users  either  bilaterally  or 
through  industry  or  trade  association), 
or  participating  in  research  studies  con¬ 
ducted  by  the  state  employment  security 
system.  Where  different  locations  are 
combined,  care  is  needed  to  insure  that 
the  jobs  studied  are  in  fact  the  same  and 
that  the  study  is  adequate  and  in  con¬ 
formity  with  the  Guidelines  (see  §  6) ; 

5.  CMnbinlng  essentially  similar  jobs 
into  a  single  study  sample  may  in  some 
circumstances  be  consistent  with  the 
Guidelines  (see  §  5g  and  §  12b) . 

38.  Q.  If  a  user  has  previously  engaged 
in  discrimination  against  members  of  a 
racial,  sex  or  ethnic  group.  Is  the  user 
precluded  from  making  its  selection  pro¬ 
cedures  more  stringent? 
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A.  In  such  circumstances,  the  Guide¬ 
lines  provide  (S  9)  that  the  user  should 
afford  those  members  of  the  groiq;>  dis¬ 
criminated  against,  who  were  available 
In  the  rdevant  Job  market  during  the 
period  of  discriminatory  practices,  an 
opportunity  to  qualify  under  the  less 
stringent  procedures,  imless  the  user^ 
demonstrates  that  the  more  stringent 
procedures  are  required  for  the  safety  or 
efficiency  of  the  operation.  The  user  is 
not'  precluded  from  using  the  more 
stringent  procedure.s  for  all  other  per¬ 
sons. 

39.  Q.  If  a  user  has  all  selection  pro¬ 
cedures  administered  by  an  employment 
agency  or  a  consultant,  does  that  relieve 
the  user  of  responsibilities  under  the 
Guidelines? 

A,  No.  The  user  remains  responsible  for 
the  selection  procedures  utilized  by 
others  on  behalf  of  the  user.  It  is  there¬ 
fore  expected  that  the  user  will  have  suf¬ 
ficient  information  available  to  show: 

(a)  what  selection  procedures  are  being 

used  on  its  behalf;  (b)  the  adverse  im-  v 

pact  of  those  procedures,  and  evidence 

of  the  validity  of  any  such  procedures; 

and  (c)  the  number  of  persons  by  race, 

sex  and  ethnic  group  referred,  and  the 

total  number  considered  for  referral  or 

for  Job  applications. 

(FH  Doo.77-1932  Piled  1-18  77;9:05  am) 
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Title  41 — Public  Contracts  and  Property 
Management  ) 

CHAPTER  60 — OFFICE  OF  FEDERAL 
CONTRACT  COMPLIANCE  PROGRAMS, 
EQUAL  EMPLOYMENT  OPPORTUNITY, 
DEPARTMENT  OF  LABOR 

PART  60-3 — GUIDELINES  ON  EMPLOYEE 
SELECTION  PROCEDURES 

CROSS  REFERENCE;  For  a  document 
issued  by  the  Department  of  Justice,  Uie 
Department  of  Labor,  Office  of  Federal 
Contract  Compliance  Programs,  and  the 
Civil  Service  Commission  on  the  subject 
of  questions  and  answers  on  the  Federal 
Executive  Agency  Guidelines  on  Em¬ 
ployee  Selection  Procedures  (41  FR 
51744)  see  FR  Doc.  77-1932  also  appear¬ 
ing  in  this  Part  VIII  of  the  issue. 
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NOTICES 


CIVIL  SERVICE  COMMISSION 

EMPLOYEES  SELECTION  PROCEDURE 
GUIDELINES 

Appendices  to  Federal  Personnel  Manual 
Supplements 

Cross  Reference:  For  a  document  is¬ 
sued  by  the  Department  of  Justice,  the 
Department  of  Labor,  Office  of  Federal 
Contract  Compliance  Programs,  and  the 
Civil  Service  Commisison  on  the  subject 
of  questions  and  answers  on  the  Federal 
Executive  Agency  Guidelines  on  Em¬ 
ployee  Selection  Procedures  (41  FR 
51752)  see  FR  Doc.  77-1932  also  appear¬ 
ing  in  this  Part  VIII  of  the  issue. 
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would  you 
like  to  know 

if  any  changes  have  been  made  in 
certain  titles  of  the  CODE  OF 
FEDERAL  REGULATIONS  without 
reading  the  Federal  Register  every 
day?  If  so,  you  may  wish  to  subscribe 
to  the  “Cumulative  List  of  CFR 
Sections  Affected,"  the  "Federal 
Register  Index,"  or  both. 

Cumulative  List  of  CFR  Sections  Affected 

$10.00 

per  year 

The  “Cumulative  List  of  CFR  Sections 
•  Affected"  is  designed  to  lead  users  of 

V  the  Code  of  Federal  Regulations  to 
^  ^  amendatory  actions  published  in  the 
""  Federal  Register,  and  is  issued 

monthly  in  cumulative  form.  Entries 
indicate  the  nature  of  the  changes. 


Federal  Register  Index 


$8.00 

per  year 


Indexes  covering  the 
contents  of  the  daily  Federal  Register  are 
issued  monthly,  quarterly,  and  annually. 

Entries  are  carried  primarily  under  the 
names  of  the  issuing  agencies.  Significant 
subjects  are  carried  as  cross-references. 


A  finding  aid  is  included  in  each  publication  which  lists 
Federal  Register  page  numbers  with  the  date  of  publication 

in  the  Federal  Register. 

Note  to  FR  Subscribers:  FR  Indexes  and  the 
“Cumulative  List  of  CFR  Sections  Affected"  will  continue 
to  be  mailed  free  of  charge  to  regular  FR  subscribers. 


Mail  order  form  to: 

Superintendent  of  Documents,  U.S.  Government  Printing  Office,  Washington,  D.C.  20402 


There  is  enclosed  S — 


for . 


.  subscription(s)  to  the  publications  checked  below: 


.  CUMULATIVE  LIST  OF  CFR  SECTIONS  AFFECTED  ($10.00  a  year  domestic;  $12.50  foreign) 
FEDERAL  REGISTER  INDEX  ($8.00  a  year  domestic;  $10.00  foreign) 


Name 

Street  Address 
City _ _ 


State _ 


ZIP 


Make  check  payable  to  the  Superintendent  of  Documents 


■#r  GPO;  m-o-SS-ooo 
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